Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[core] Split configuration for device and others in compile model #26977

Open
wants to merge 38 commits into
base: master
Choose a base branch
from

Conversation

praasz
Copy link
Contributor

@praasz praasz commented Oct 9, 2024

Details:

  • The ov::Core compile model filter provided configuration and send hardware devices configuration with supported properties only. There is no exception if plugin not supported property added.
  • Sync supported properties in plugins to proper filter in compile_model
  • Filtering device properties by compile_model will improve keep supported properties by device up-to-date.

Tickets:

@praasz praasz requested review from a team as code owners October 9, 2024 13:35
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: IE Tests OpenVINO Test: plugins and common labels Oct 9, 2024
@praasz praasz requested review from a team as code owners October 13, 2024 19:07
@github-actions github-actions bot added category: CPU OpenVINO CPU plugin category: AUTO OpenVINO AUTO device selection plugin labels Oct 13, 2024
@praasz praasz requested a review from a team as a code owner October 14, 2024 06:35
@github-actions github-actions bot added the category: AUTO BATCH OpenVINO Auto Batch plugin label Oct 14, 2024
@praasz praasz requested a review from ilya-lavrenov October 14, 2024 06:52
@praasz praasz requested a review from a team as a code owner October 14, 2024 07:27
@github-actions github-actions bot added the category: TEMPLATE OpenVINO Template plugin label Oct 14, 2024
to forward it after config filter by device

Signed-off-by: Pawel Raasz <[email protected]>
@praasz praasz requested review from a team as code owners November 20, 2024 13:54
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Nov 20, 2024
Copy link
Contributor

@ilya-lavrenov ilya-lavrenov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that main problem in handling of core level properties is that coreConfig is updated only via Core::set_property, while Core-level properties can also be passed to compile_model or other methods with properties.

Maybe we need to update parseDeviceNameIntoConfig to return updated coreConfig as well? Such updated Core config is created as:

auto updatedCoreConfig = coreConfig;
updatedCoreConfig.set_and_update(config); // set_and_update removes core-level properties from config; so, other properties can be safely passed to plugins

@praasz praasz requested a review from ilya-lavrenov December 4, 2024 19:14
@praasz praasz requested a review from t-jankowski December 10, 2024 13:00
@github-actions github-actions bot removed the category: HETERO OpenVINO HETERO plugin label Dec 10, 2024
Signed-off-by: Raasz, Pawel <[email protected]>
@praasz praasz force-pushed the split-config-in-compile-model branch from eaef130 to 46c05ba Compare December 10, 2024 13:03
@github-actions github-actions bot removed the category: CPU OpenVINO CPU plugin label Dec 10, 2024
@praasz praasz requested a review from ilya-lavrenov December 11, 2024 06:52
class CoreConfig final {
public:
CoreConfig() = default;
CoreConfig(const CoreConfig& other);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There should be operator= either defined or deleted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: AUTO BATCH OpenVINO Auto Batch plugin category: AUTO OpenVINO AUTO device selection plugin category: GPU OpenVINO GPU plugin category: IE Tests OpenVINO Test: plugins and common category: inference OpenVINO Runtime library - Inference category: TEMPLATE OpenVINO Template plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants